Efficient recursive least squares solver for rank-deficient matrices
نویسندگان
چکیده
Updating a linear least squares solution can be critical for near real-time signalprocessing applications. The Greville algorithm proposes simple formula updating the pseudoinverse of matrix A $\in$ R nxm with rank r. In this paper, we explicitly derive similar by maintaining general factorization, which call rank-Greville. Based on formula, implemented recursive exploiting rank-deficiency A, achieving update minimum-norm least-squares in O(mr) operations and, therefore, solving problem from scratch O(nmr) operations. We empirically confirmed that displays better asymptotic time complexity than LAPACK solvers rank-deficient matrices. numerical stability rank-Greville was found to comparable Cholesky-based solvers. Nonetheless, our implementation supports exact representations rationals, due its remarkable algebraic simplicity.
منابع مشابه
Rank based Least-squares Independent Component Analysis
In this paper, we propose a nonparametric rank-based alternative to the least-squares independent component analysis algorithm developed. The basic idea is to estimate the squared-loss mutual information, which used as the objective function of the algorithm, based on its copula density version. Therefore, no marginal densities have to be estimated. We provide empirical evaluation of th...
متن کاملSolving Rank-Deficient Linear Least-Squares Problems*
Numerical solution of linear least-squares problems is a key computational task in science and engineering. Effective algorithms have been developed for the linear least-squares problems in which the underlying matrices have full rank and are well-conditioned. However, there are few efficient and robust approaches to solving the linear least-squares problems in which the underlying matrices are...
متن کاملGauss-Seidel Iterative Methods for Rank Deficient Least Squares Problems
We study the semiconvergence of Gauss-Seidel iterative methods for the least squares solution of minimal norm of rank deficient linear systems of equations. Necessary and sufficient conditions for the semiconvergence of the Gauss-Seidel iterative method are given. We also show that if the linear system of equations is consistent, then the proposed methods with a zero vector as an initial guess ...
متن کاملApplication of Recursive Least Squares to Efficient Blunder Detection in Linear Models
In many geodetic applications a large number of observations are being measured to estimate the unknown parameters. The unbiasedness property of the estimated parameters is only ensured if there is no bias (e.g. systematic effect) or falsifying observations, which are also known as outliers. One of the most important steps towards obtaining a coherent analysis for the parameter estimation is th...
متن کاملAlgorithm xxx: an Efficient Algorithm for Solving Rank-Deficient Least Squares Problems
Existing routines, such as xGELSY or xGELSD in LAPACK, for solving rank-deficient least squares problems require O(mn) operations to solve min ‖b−Ax‖ where A is an m by n matrix. We present a modification of the LAPACK routine xGELSY that requires O(mnk) operations where k is the effective numerical rank of the matrix A. For low rank matrices the modification is an order of magnitude faster tha...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Mathematics and Computation
سال: 2021
ISSN: ['1873-5649', '0096-3003']
DOI: https://doi.org/10.1016/j.amc.2021.125996